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ABSTRACT 

The purpose of this paper is to summarize and review 
the results of the Harvard Project Physics (EPP) research and 
evaluation activity to make available to interested science educators 
the design, implementation, and results of a major curriculum 
evaluation effort. This activity was conducted during the years 
1965-1970 and had considerable support, from the U. S. Office of 
Education. The findings are summarized as follows: (1) Methodology; 

{a) Various cognitive, affective, and behavioral measures used as 
criteria, (b) Pilot test of design and instruments, and (c) 
Implementation on a national random sample; (2) Teachers; (a) 
Characteristics of physics teachers, (b) Effects of participation in 
the program; volunteer teachers in the program were different than 
the randomly-selected group; and participation in summer institutes 
did change attitudes but not nearly as much as actually teaching the 
HPP course; (3) Students; (a) Characteristics, (b) Student learning 
and the effects of teacher characteristics, amount of instruction, 
and the HPP course, (c) Enrollment with regard to text used, teacher 
attitudes, and grading practices; and (4) Research on learning 
environments. The development of the Learning Environment Inventory 
{LEI) is described. The final evaluation found that students rated 
HPP lower than "other physics" on difficulty, mathematics, and 
applied, but higher on satisfaction, diversity, history, philosophy, 
humanitarianism, and social. A summary of the significant findings is 
given as well as an extensive bibliography. (TS) 
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SCIENCE, MATHEMATICS, AND ENVIRONMENTAL 



EDUCATION INFORMATION REPORTS 



The Science, Mathematics, and Environmental Educat i on Information 
Reports are being developed to disseminate information concerning docu- 
ments analyzed at the ERIC Information Analysis Center for Science, 
Mathematics, and Environmental Education. The reports include four 
types of publications. Special H l fcliographies are developed to announce 
availability of documents in selected interest areas. These bibliog- 
raphies will list most significant documents that have been published 
in the interest area. Guides to Resource Literature for Science , 
Mathematics, and Environmental Education Teachers are bibliographies that 
identify references for the professional growth of teachers at all levels 
of science, mathematics, and environmental education. Research Reviews 
are issued to analyze and synthesize research related to science, 
mathematics, and environmental education over a period of several years. 
The Occasional Paper Series is designed to present research reviews and 
discussions related to specific educational topics. 

The Science, Mathematics, and Environmental Education Information 
Reports will be announced in the SMEAC Newsletters as they become 
available. 
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REVIEW OF THE RESEARCH AND EVALUATION PROGRAM 
OF HARVARD PROJECT PHYSICS 

by 

Wayne W. Welch* 

-* University of Minnesota 

INTRODUCTION 

During the 1960's a number of national curriculum development pro- 
jects were supported by the federal government. Although the greater 
share of effort was directed toward developmental activities, a few pro- 
jects were involved with active programs of research and evaluation. One 
of these was Harvard Project Physics, a humanistic approach to the study 
of physics at "the secondary school level. With considerable f.inancial 
support from the U.S. Office of Education, an extensive program of 
research and evaluation was conducted during the last half of the decade . 
As a result of that activity, more than 60 articles, monographs, and 
dissertations were produced. It is the purpose of this paper to sum- 
marize and review the results of the Harvard Project Physics research 
and evaluation activity to make available to interested science educators, 
the design, iixpleirentatian, and results of a major curriculum evaluation 
effort. It is hoped that bringing together in one place a glinpse of a 
multifaceted research and evaluation program will help to r\ 5 duce the com- 
munication gap that all too of ten exists between the researcher and "die 
practitioner . 



*Wayne W. Welch served as Evaluation Coordinator for Harvard Project 
Physics from 1965-1969. 
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BACKGROUND 

The group given the responsibility of evaluating Project Physics was 
guided by three beliefs: (1) Evaluation can be used during the develop- 

ment of a course to help improve the course; (2) Evaluation can be applied 
to the final course materials and provide data upon which school personnel 
can base decisions concerning adoption and use of the courses; (3) A 
national project funded by the U.S. Office of Education has an obligation 
to conduct research on the evaluative process itself, and to investigate 
sane of the basic problems in teaching and learrdng. 

As a result of these three beliefs, an evaluation strategy evolved 
during the four-year formal evaluation of Harvard Project Physics (HPP) . 

As implied by the statements above, the elements of this strategy include: 
(1) formative evaluation to be used for course improvement, (2) surnnative 
evaluation for consideration by potential users of the course, and (3) 
research on the evaluation methodology and the factors that may affect 
teaching and learning. These three goals were stressed sequentially in 
HPP, as Figure I shows. 



FIGURE I 

TIME LINE OF ACTIVITIES 

Year 

Goal 1555-56' 1955-57 1957-65 1966-65 

1. Course Improvement 

2 . User Information 

3. Educational Research 
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Pursuance of these three goals by a staff supported by the Project 
resulted a number of publications describing the research and evalua- 
tion findings. These publications aie the basis of this review. 

An analysis of the studies suggested severed categories in which to 
group findings. Tines e are somewhat analogous to categories suggested by 
the general goal of the HPP research to determine "What happens to differ- 
ent kinds of students working with different kinds of teachers in the 
Project Physics course?' 1 

The rubrics under which the various research and evaluation findings 
are grouped are listed belcw: 

A. Methodology 

B. Teachers 

C. Students 

D. Learning Environments 

Articles that are primarily concerned with each of these four topics 
are reviewed as a group. In addition, a section is included (Section E) 
that summarizes the results of the final evaluation year, heretofore 
unpublished . 



SUMMARY OF FINDINGS 



A. Methcdology 

A general overview of the Project Physics evaluation strategy is 
described by Welch and Walberg (44). In addition, the various data 
gathering techniques sre listed and referenced in their article. 
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In brief , the evaluation four-year plan was as follows : 

Year 1 - Develop instruments and refine overall plan. 

Year 2 - Pilot test evaluation design and instruments 
on a selected sample. 

Year 3 - Implement the evaluation plan on a national 
randan sample of physics teachers. 

Year 4 - Analyze and disseminate results. 

Three elements of the HPP design make it somewhat unique among 
science curriculum development groups. First, various cognitive, affec- 
tive, and behavioral measures were used as criteria. Second, a true 
experimental design was employed. Third, the evaluation plan was trial- 
tested prior to its final implementation. While these components do not , 
of themselves , insure a successful program , they do point out the attempt 
to follow the tenets of experimental design. 

Many of the studies of students, teachers, and learning environments 
were conducted as complements to the evaluation plan mentioned above. 

For example, as the group of selected teachers were pilot testing the 
evaluation design in Year 2, research studies were being conducted 
simultaneously on those teachers to ascertain their unique personality 
characteristics . 

Several new evaluation techniques were developed as a result of 
Harvard Project Physics. A system of randomized data collection (31) was 
employed to reduce the total testing time required of any one student. 

Also the advantages and limitations of making a national random sample of 
physics teachers with random assignment to experimental and control groups 
were described (48). Among the more difficult of the design problems was 
the development of measuring instruments to assess the many goals of the 
course. Several of these instruments were researched and are described by 
Geis (8), Ahlgren (1), and Anderson (4). 
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Geis (8) presented a thorough review of the literature on the 
semantic differential test as a means for measuring attitudes . He pointed 
out the problems in using the semantic differential to measure attitudes 
on an absolute scale, but made an argument for its value in assessing 
attitude change. Ahlgren (1) described a technique of confidence testing 
as a means of assessing pupil achievement. Confidence testing permits 
the student to indicate his degree of confidence in the correctness of 
his response. Such a technique increases test reliability and is a good 
predictor of long-term retention. 

Another measuring technique that was developed by the HPP staff was 
the Learning Environment Inventory (LEI). This instrument was an impor- 
tant part of the research program of the project. Because it was not 
feasible to visit a national population of physics classes, a paper and 
pencil alternative was devised to determine students * perceptions of the 
classroom climate. Anderson (4) described the rationale of the LEI and 
presented validity and reliability evidence. This LEI was used both as 
a criterion for evaluating the course and as a means to describe what was 
occurring in the many physics classes. Further discussion of the LEI is 

found in a later section in this review. 

A nodel for research on instruction in connection with an evaluation 
effort was developed by Walberg (14). He described the need to consider 
student learning in terms of aptitude, instruction, environment, and the 
interaction of these variables. This model was tested in the HPP program 
using the criterion of physics achievement . 
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A final methodological problem that grew out of the evaluation pro- 
gram was explored by Welch and Walberg (47). Their research indicated no 
pretest sensitization effects for either cognitive or affective measures 
when the interval between testings was seven months and test taking was 
part of the normal class activity . 

B. Teachers 

A second major category of studies focused on teachers , physics 
teachers in this instance. It is possible to separate the studies into 
two groups: (1) those concerned with the characteristics of physics 

teachers and (2) those describing various effects of participation in the 
program. 

During the pilot test of the evaluation design, a select group of 
teachers was used because of the need to obtain feedback on course 
materials . One source of concern in prior curriculum evaluation studies 
was the effect of using volunteers during a course evaluation. To provide 
seme understanding of this problem, a study (33) compared 36 volunteer 
physics teachers with national norms and with data collected from teachers 
attending physics institutes. The select teachers scored significantly 
higher on measures of theoretical and aesthetic values than other high 
school teachers , but lower on measures of economic , religious , and 
political values. The innovative teachers scored much higher on tests 
of physics achievement. While they were close to the norm group on teach- 
ing attitudes , they had a lcwer need for affiliation than did the norm 
group. On the Edwards Personnel Preference Schedule, the select group 
scored lower on the need for abasement and affiliation, but higher on the 
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need for autonomy and heterosexuality. It was tentatively concluded 
that volunteer teachers weie in fact markedly different from typical 
teachers. These results motivated in part the decision to select experi- 
mental teachers on a ra T dan basis the follcwinp; year. 

During the main evaluation year, the participating physics teachers 
were selected randomly frcm the 17,000 physics teachers in the nation (48). 
The randomly selected teachers differed frcm their volunteer counterparts 
in training in mathematics and science. The select teachers had an average 
of 40 semester credits in physics while the average for the random sample 
was 23 semester hours. Also, the select group scored significantly higher 
on a test of physics achievement (11, 33). 

A study of 162 NSF institute teachers by Welch and Walberg (46), 
indicated that two- thirds were using traditional physics texts while 23 
percent were using the PSSC text. Sixty percent were teaching only one or 
two classes of physics and the average number of physics students per 
teacher was s lightly less than 50 . This group expressed strong agree- 
ment with the philosophy that physics is needed by all students , not just 
the academically elite. 

In a study related to the HPP evaluation, Welch and Walberg (45) 
assessed the effect of four NSF summer institute programs. One of the 
institutes was an HPP institute. Significant gains on a physics achieve- 
ment test were found at all four institutes. In addition, chree of the 
four programs showed significant gains on two different measures of 
scientific processes. 
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Rothman (11, 12) conducted two studies to assess the relative impact 
on teachers of teaching a course and of attending a summer institute • 

Using the semantic differential as a measure of interest, he found that 
teachers became favorably disposed towards the content and activities of 
physics in teaching the HPP course. By comparison, the change in attitude 
effected by summer institute attendance was minimal. 

C. Students 

A large share of the Project Physics research and evaluation studies 
was conoemed with students ; their characteristics , factors affecting 
learning , and enrollments in physics . During the early years of the 
Project, it was important to identify traits of the -typical high school 
physics student (38). This information was helpful to curriculum developer’s 
because it described one of their target audiences. As the Project neared 
completion , it became more important to determine the impact of the course 
on student achievement and attitudes (49). Articles concerned with both 
of these components are reviewed in this section. In addition, several 
studies of physics enrollments are discussed because of the Project's 
general objective to increase secondary level physics enrollments • 

1 . Characteris tics 

In a survey conducted in 1968, Welch (38) found the average physics 
student was a bright senior planning on college, having strong mathematical 
and science interests and placing high value on the pursuit of truth. 

Girls were found to differ even more from their comparison norm groups 
- ’ on measures of science interest and achievement. Several questions were 

raised in this study about the lack of appeal physics has even among the 
rather elite group of young men and women who normally elect physics. 

m, i3 
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In an interesting set of studies, Walberg contrasted characteristics 
of boys and girls in science (17, 19) and examined severed nonscience 
aspects of students in physics (15, 22). Primary motivation for these 
studies was the desire to present to course developers an accurate image 
of the select group of students who enroll in physics. Student responses 
to biographic items on reading and study habits were tabulated (22). 
Evidence of a low interest in reading (e.g. 25 percent did not read non- 
fiction) was found as well as a general dislike of school (e.g. 75 percent 
reported difficulty in concentrating on their studies). 

In recent years, a number of writers have described the growing 
alienation of artists and humanists from the science and technology of 
our times. Because the staff of Project Physics was trying to develop a 
course suitable for a broader group of students than potential scientists , 
it seemed worthwhile studying the other side of the "two cultures . " Com- 
parisons were made among three groups of students on items of the Bio- 
graphic Inventory (15). The groups were those winning awards in science, 
in the arts, and no awards at all. The first two groups were called 
"scientists" and "artists" respectively. The third group was called "non- 
winners . " 

The three groups differed significantly on many of the items, for 
example, on measures of creativeness, imagination, curiosity, role 
expectation, and school satisfaction. Walberg (15) recommended, on the 
basis of this study , the need for a multifaceted physics course , that is , 
a course with a broad range of elements that would help meet the diverse 
needs and interests of the students in physics. 
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Another group of students that caught the research interests of the 
Project Physics staff was girls enrolled in science courses. Because 
there are relatively few girls who enroll in physics and also so few women 
in science who attain eminence, it was considered important to assess 
possible inherent tensions between scientific and feminine roles. 

Samples of boys and girls in the group of students studied by the Project 
Physics staff were contrasted on selected cognitive, attitudinal, and 
personality measures . Differences between boys and girls in the physics 
sample were compared to a list of thirteen traits, compiled by Taylor and 
Behren, that distinguished creative scientists from noncreative scientists. 
On these thirteen traits, there was considerable variation between boys 
and girls , with boys showing the characteristics that were closely aligned 
with characteristics of creative scientists. These included such things 
as a high* degree of autonomy, self-sufficiency and self-direction, a 
preference for mental manipulations involving things rather than people, 
a high degree of personal dominance, and a marked independence of judgment; 
that is, a rejection of group pressures towards conformity and thinking. 
Walberg (17, 19) concluded that the apparent trait discontinuities 
between feminine and scientific roles may help to explain the relatively 
low percentage of girls in physics and the relatively poor shewing of 
women in scientific careers. 

2. Student Learning 

A guiding principle behind the research and evaluation activity of 
Project Physics was that evaluation is the gathering of data to assist in 
decision making. The staff charged with the evaluation responsibility 
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identified decisions facing teachers, school administrators, and students 
and gathered information to aid in these decisions. The research com- 
ponent of Project Physics was designed to gather information of general 
value to the overall improvement of education. In this section, 
studies concerned with the factors that affect student learning are 
reviewed. Studies were conducted to determine the impact of teacher 
characteristics, classroom climate, teaching duration, students recruited 
into the course, and course satisfaction on student learning. The final 
section of this part of the review concentrates upon the curricular 
effects on student learning, the curriculum in this case being the Harvard 
Project Physics course. 

It is generally held that knowledge of the subject matter possessed 
by a teacher will have an influence upon his teaching effectiveness . To 
determine the validity of this assumption, a set of studies was conducted 
that correlated several teacher characteristics with students ’ gains on 
both cognitive and affective measures. Contrary to what might be expected, 
it was found that teacher personality characteristics exert a more power- 
ful influence than does content preparation on what students learn, how 
their interest changes, and their overall attitude towards physics (12, 

29, 34). 

In the first study in this sequence (12), it was found that teachers' 
personalities and value systems were more strongly related to students ' 
changes in physics achievement , attitude towards physics , and interest in 
science than were the extent of teachers * preparation in physics , mathe- 
matics , knowledge of physics , and years of physics teaching experience . 
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Furthermore , among a sample of 36 male physics teachers, it was found 
that these teachers exerted a greater influence on boys in physics than 
on girls who were enrolled in physics. In a replication of this study 
using a random sampling of physics teachers, Walberg and Rothman (29) 
again found that teacher personality traits as measured by the Study of 
Values and the Edwards Personal Preference Schedule were better predictors 
of what students learned and how their attitudes changed than was previous 
training in physics. However, in the replication study using the random 
sampling of teachers, there was a slight correlation (r = .26) between 
knowledge of physics possessed by teachers and knowledge of physics gained 
by students. The strong relationship between personality and value 
measures was replicated in the second year. 

To examine the relationship between teacher personality and student 
learning in more detail, an identification hypothesis was proposed (34) 
that predicted that male students in a classroom learn physics better 
because of the modeling behavior exhibited by the male physics teacher. 

The hypothesis also explained the decrease in interest, in that the male 
model in the classroom may in fact be a rival for the attention of female 
students in the same class . While this hypothesis had seme interesting 
ramifications, the data supporting it from physics classes alone are not 
adequate to state with any degree of certainty that the hypothesis was 
supported. 

The results of this set of three studies emphasize the need for 
scientists and science educators to examine more critically a training 
program of science teachers that fixes upon subject matter preparation 
and almost completely neglects teacher personality development. 
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Another set of HPP studies focused upon a measure of classroom 
climate as a predictor of student learning. These studies will be examined 
in more detail in the next section. In brief , using the Learning Environ- 
ment Inventory (LEI) to assess students' perceptions of the activities 
taking place in their classrooms , there was a positive correlation with 
scores on this instrument and meas'ires of student achievement and student 
attitude. The conclusion drawn from this set of studies (and again this 
will be elaborated in the next section) is that the students' perception 
of what occurs in a class roam is a good predictor 1 of the outcome measures 
of physics student achievement. 

A formative evaluation study, conducted by Welch and Bridgham (42), 
was concerned with determining the effect of varying amounts of instruction 
on a selected physics unit. Using the adjusted class mean gains on a 
physics achievement test , no relationship was found between the number of 
days that a Project Physics unit was taught and the resulting achievement 
gains when the range of instruction was from 25 days to 62 days. Because 
the unit was designed for students and teachers to finish within 30 days , 
this information was useful in determining an appropriate length of the 
course. 

The correlation between the teaching duration (ranging from 25 to 
62 days) and the mean achievement gain for a class was -.08, not signifi- 
cantly different from zero at the .05 level. The study was conducted on 
a total or 41 different classes. In a supplementary study on teaching 
duration, the length of time required to present the physics unit was found 
not to be correlated with mean class ability. Initially, it was hypothesized 
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that teachers would tend to go slower with a class of less able students. 
The findings did not support the hypothesis. 

Welch (35) examined the impact of course satisfaction upon student 
learning. He found that satisfaction is related to achievement gains, 
greater participation in science activities, and course grades. He also 
found a negative relationship with perceived course difficulty. The 
measure of course satisfaction was responses by students to items such as , 
"I would recommend this course to my friends," and "This course is one 
of the most interesting I have had in high school." It was also found 
that course satisfaction was not correlated significantly with student 
ability or initial interest in science but the changes that occurred to 
students during the year seemed to have an effect upon their overall 
course satisfaction. 

For a course that was designed to attract a new group of students to 
enroll in physics , a study of the success of this group seemed in order 
as part of the research program of the project. Accordingly, a group of 
190 students that were recruited (recruits), i.e. selected and encouraged 
by teachers to enroll in physics during the 1966-67 school year, was 
compared on twelve different criterion measures with students who enrolled 
in physics of their own (volunteers). The criteria were achievement, 
general understanding of science, interest in science, and participation 
in science-like activities. In summary, it was found that the gains of 
the recruited students on these measures were equal to gains made by stu- 
dents who volunteered to take physics. The implication of this evaluation 
study is that if teachers and school administrators can lure students 
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into the Harvard Project Physics course, apparently such students will 
be just as successful on these select criteria as students who would 
enroll in the course of their own volition. 

In the final study related to this section (49) , the impact of Pro- 
ject Physics upon student learning was assessed. Comparisons were made 
between the Project Physics course and other physics courses to determine 
the dif fering influence upon physics students using 72 different criterion 
measures including the cognitive, affective, and behavioral domains. A 
summary of the findings of this study will be presented in Section E of 
this review. 

3 . Enrollment 

Because Project Physics was designed in part to help stem the declin- 
ing trend of enrollment in physics, the evaluation and research staff was 
concerned with assessing the impact of Project Physics upon physics enroll- 
ment. In order to obtain an estimate of enrollment in physics, Welch (40, 
41) examined methods by which enrollment, in existing physics courses were 
determined. Of most particular interest was the enrollment in the course 
developed by the Physical Science Study Committee (PSSC), This course 
had been in operation approximately eight years before Project Physics , 
with quoted enrollment figures indicating the percentage of the total market 
using the PSSC materials. However, the enrollment figures varied con- 
siderably among the various agencies doing the counting: USOE, NSF, and 

several private agencies. A similar contradiction appeared in the new 
curriculum projects in chemistry and biology. Welch cautioned, on the 
basis of his study, that the use of textbook sales as an estimate for 
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enrollment in science courses was very suspect and urged that an indepen- 
dent group not connected with arty of the curriculum projects be assigned 
the task of accurately measuring enrollment in science courses. 

In a related study using a national sample of 124 physics teachers 
randomly selected fran a total population of 16,911, Welch (37) reported 
that 50 percent of the teachers were using a conventional textbook, 

Modem Physics , by Dull , Metcalf and Williams ; 26.5 percent of the teach- 
ers were using the PSSC textbook, and 23.5 percent of the physics teachers 
were using other textbooks. At the time of the study, enrollment in Pro- 
ject Physics could not be obtained because the course was not available 
on a nationwide basis. However, Welch urged that a true test of the Pro- 
ject Physics impact could be obtained five years in the future (1974) by 
making an accurate determination of its usage. 

Because it was thought that the source of low interest in physics, 
and therefore low enrollment in physics, might be due to teachers' atti- 
tudes , a questionnaire was administered to 162 physics teachers attending 
summer institutes in preparation for teaching physics in subsequent years 
(46). Questions were designed to determine if the attitudes of teachers 
oould be the reason for low student interest. However, responses such as 
the following, "Ninety-five percent stated that physics should be taken by 
girls ," "Eighty- two percent agreed that all high school graduates should 
have sore understanding of physics," and other related items led to the 
conclusion that physics teachers as a group believed that more, rather 
than fewer, students should be taking physics. 
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In the final study in this series, Bridgham and Welch (7) found a 
relationship between the grading practices of physics teachers and physics 
enrollment. They determined that teachers who assign grades lcwer than 
students normally receive tended to have smaller physics classes. Although 
-the relationship was determined in only one of three criteria used to 
analyze the data, -the results do suggest an association between severity 
of grading and current and future enrollments in physics courses. Accord- 
ingly, Project Physics staff members urged physics teachers to be fair 
and understanding in assigning grades in physics. 

D. Research on Learning Environments * 

A large block of research studies associated with Harvard Project 
Physics focused upon learning environments as a factor in student learn- 
ing. Original interest in measuring classroom environments arose when 
it became necessary to evaluate the effectiveness of the Project Physics 
under different classroom conditions. Available behavioral scales and 
observations were examined, but these were rejected for several reasons: 
the problem of training staff sufficiently to produce objective, reliable 
results, travel costs to scattered locations throughout the country, and 
the unnatural, sometimes threatening, nature of a strange observer in the 
classroom. But the most important reservation was the validity of these 
measures - , few studies have reported significant predictions of learning 
from them, and these few have failed to account for substantial variance, 
say 20 percent, in learning criteria. 

*The content of this section is adapted in part from "A Case Study 
in Curriculum Evaluation: Harvard Project Physics" by Welch, Walberg, and 

Watson (49). 
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Aside from the necessity of a potentially obtrusive observer, the 
available measures may be handicapped by one-dimensional scores which do 
not reflect the complexity of the classroom. Further, they largely assess 
teacher behavior , and even in these cases , they focus on the frequency 
rather than relative intensity of acts such as rewards. For example, it 
seems obvious that one wirik frcm a grouchy teacher during a semester may 
be more important to the student than lots of verbal praise from a teacher 
conditioned to gush. Since a stimulus frcm the teacher, fellow students, 
the text, or other sources affects learning only insofar as it registers 
with the learner, a logical starting point seemed to be the student's 
perception of the learning environment. 

Hemphill and Westis developed the Group Dimensions Description 
Questionnaire to measure general characteristics of adult groups , and 
their work is the most extensive factor analytic research on group pro- 
perties. The items are inappropriate for the classroom group, but they 
did suggest a number of dimensions possibly related to learning. On the 
basis of these dimensions and others hypothesized to be relevant, 90 
items were written for the Classroom Climate Questionnaire (CCQ) . The 
instrument was administered to a national sample of 500 high school physics 
students . The items were factor analyzed and the resulting factor scores 
W ere used in a series of studies described be lew . Despite the validity 
of this instrument, psychometric studies showed that the scales were 
unreliable and redundant, and work began on a new instrument, the Learning 
Environment Inventory (LEI). 
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The Getzels-Thelen theory of the class as a social system had proven 
usef ul in prior research, and was used as a guide for constructing the new 
instrument. Item and intuitive criterion analyses were employed to 
increase the reliability and validity of scales fron the first instrument 
and an effort was made to reduce the intcr-oorrelations among scales . 
Assuming a maximum testing of 40 minutes to tap the fourteen dimensions 
thought important for learning, seven items per scale were selected. 
Spearman-Brown forecasts indicated moderate internal consistency relia- 
bilities, from .5 to .8. These are tolerable since the goal was to measure 
many dimensions validly rather than a few very reliably . 

One of the first studies of learning environments examined the cor- 
relations between the CCQ scales and several posttests regression-adjusted 
for initial differences on corresponding pretests (27). This study 
employed individual students as the units of analysis. More specifically, 
the study tested the hypothesis that eighteen structural and affective 
aspects of classroom climate predict nine cognitive, affective, and 
behavioral adjusted posttests. Simple and multiple correlations revealed 
significant and complex relations between climate measures and learning 
criteria. For example. Stratification and Friction predicted science 
understanding, but other climate variables predicted physics achievement 
and attitudes toward laboratory work. In addition, groups of climate 
variables correlated with learning better than others. These groups of 
climate variables had been identified in an earlier study (24). Amon 
the structural variables , "isomorphism*’ (the tendency for class members 
to be treated equally) and "organization” (efficient direction of activity) 
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predicted learning much better than "coaction" (compulsive restraint or 
coercion) . Among the affective climate measures , "synergism" (personal 
relations among class members) predicted learning better than "syntality" 

( identification with group goals ) . This exploratory study indicated that 
further studies of the instrument were worthwhile on the select group and 
that it would be feasible to construct a better instrument for future 
work. 

All the other studies of idle select group of teachers used class 
means as the units of analysis. One of these (5) was similar to the first 
study except for the analytic units. The latter study employed the eighteen 
climate scales to predict raw gains (posttest minus the pretest) of classes 
on a physics achievement test, a science understanding test, and a semantic 
differential measure of physics interest. Multiple correlations revealed 
significant predictions could be made, and canonical correlations revealed 
two of the variates joined the predictors and criteria. The first variate 
predicted gains on all three criteria, but the second variate implied a 
trade-off between cognitive and nonoognitive learning. 

The separation of cognitive and noncognitive tendencies was also 
implicit in a study by Walberg and Anderson (28). This study tested the 
predictiveness of the climate scales themselves from a battery of pretests , 
The Getzels-Thelen socio- psychological framework was useful in conceptual- 
izing the research and interpreting the results. The central distinction 
of the framework is between individual "need-dispositions" and shared 
group "role-expectations" of students. The distinction seemed to fit the 
statistical description of two types of classes. The "achieving class" 
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appears to have a friendly, democratic, goal-directed character which 
would fit in nicely with the organization of the school, while the 
"creative class” seems to threaten the established adult order with diverse 
interests , friction among its members , and high group status . The 
"achieving class" seems to represent the collective role-expectations of 
the "ideal student" frcm the point of view of the educational establishment. 
On the other hand, the "creative class" is not a group conforming to a 
prescribed role but an assortment of individuals apparently expressing 
indivi du al needs: physical manipulation, inquiry, and answers to the 

impertinent, ultimate questions. The result — high status, recognition of 
diverse individual interests, friction among members, and perhaps because 
of these, the tendency to formality. Thus, classroom climate may be 
viewed as hypothesized by Getzels and Thelen as a function of interaction 
within the classroom group. 

A second series of studies used the improved instrument, the Learning 
Environment Inventory (LEI) on the random sample of physics teachers. 

One of these studies (6) was a true experiment and contrasted the physics 
classes on teacher selectness, teacher experience, and course dimensions. 
Highly significant differences were found among the three groups of this 
study. Project Physics classes taught by experiences teachers. Project 
Physics classes taught by inexperiences teachers , and control classes 
taught by experiences teachers. Of most importance was the finding that 
the course effects seem to account for considerably more variance than 
teacher selection and experience with the course (6). 
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Another study in the second series concerned class size and perceived 
environments (16). Although many teachers and students have strong prefer- 
ences for small classes, the literature suggests that there is little 
consistent evidence that class size is related to achievement and interest 
in the subject. It was hoped, however, that the LEI might detect differ- 
ences in class sizes and reveal something about their nature. Multivariate 
and univariate regression revealed significant correlations between several 
environment scales and class size. It was found that the larger classes 
tended to be more formal and diverse and less intimate and difficult. 

Using the improved environment measure (the LEI) on the 1967-68 
random sample, V/alberg (21) attempted to replicate an earlier study (5) 
predicting posttest criteria fran environment scores. Canonical analysis 
of the fourteen environment scores and six posttest learning criteria 
revealed two significant canonical variates joining the sets . The environ- 
ment s cale s by themselves accounted for up to 40 percent of the variance 
in a single criteria. Plots of the canonical variates revealed that the 
cognitive posttests were predicted (positively) mainly by perceived dif- 
ficulty. Nonoognitive achievement was mainly predicted by Satisfaction 
(positively) and by Apathy, Cliqueness, and Friction (negatively). 

A correlational study (25) of several teacher personality variables 
and the LEI was conducted to determine the effect of teachers on the learn- 
ing environment. The measures of personality included the Edwards Personal 
Preference Schedule , the Study of Values , and the Minnesota Teacher Atti- 
tude Inventory. This study indicated that the teacher does indeed influ- 
ence the social climate of learning. For example , among the findings was 
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the fact that teachers with high need for affiliation tend to have 
classes with low internal cohesiveness. The hypothesized explanation 
of this finding is found in the reinforcement literature. When the 
teacher is actively involved with the students* he becomes the source 
for student approval. On the other hand, when a teacher is distant from 
the class (low need for affiliation) the students turn to each other for 
reinforcement. This latter type of social environment would yield high 
cohesive scores. 

In the final study of this section, Walberg and Ahlgren (26) identi- 
fied predictors of the social environment of learning to determine if 
student characteristics were related to LEI scores . They found it was 
possible to accurately predict December measures of classroom climate 
using a battery of student measures obtained in September. As yet, the 
relative influence of teacher personality variables versus student 
characteristics on the social environment of learning has not been deter- 
mined. 

E. Final Evaluation Year Results 

During the last year of the organized evaluation of the Project 
Physics course, a concerted effort was made to identify those variables 
that discriminated between Project Physics and other kinds of physics 
courses . These results to date have appeared as a final USOE report and 
soon will be obtainable through the ERIC system. It seems appropriate 
at this time to summarize these findings as the final section of this 
review. 
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A total of 70 different criteria were used to assess the effects of 
the Project Physics course. A detailed analysis of these variables is 
presented by Welch, Walberg, and Watson (49) . Because of the complexity 
of the analysis, a summary of the main findings is presented in Table 1, 
page 25 . 

A total of seventeen significant results was found. "Other Physics" 
courses rated higher on the variables: difficulty, favoritism, physics is 

difficult, mathematical, and applied. However , the goals of the Project 
Physics authors were to reduce the difficulty stigma attached to physics, 
reduce the mathematical orientation, and to shew physics as an intellectual 
endeavor rather than as applied technology . The results of the study 
suggest the course was successful in achieving these goals. 

The findings on the eleven variables where the Project Physics group 
was higher can be characterized as follows : students in HPP find the 

course more satisfying, diverse, historical, philosophical, humanitarian, 
and social; their questionnaire responses suggest a belief that mathematics 
is not essential to understanding physics ; the historical approach is 
interesting; the book was enjoyable to read; their class finished the text; 
and they hoped the book would not be changed. Findings of this nature 
permit one to characterize the aura of the HPP curriculum when faced with 
adoption decisions. In addition, the above findings suggest that the 
HPP course was partially successful in achieving the objectives outlined 
ty the course developers (HPP Newsletter #8). 
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TABLE 1 

SUMMARY OF SIGNIFICANT FINDINGS 
PROJECT PHYSICS VERSUS OTHER PHYSICS 
FINAL EVALUATION YEAR 



Dependent Variable 


Univariate 

F* 


Higher 

Mean 


Course satisfaction 


9.38 


HPP 


Difficulty 


4.21 


Other 


Favoritism 


3.31 


Other 


Diversity 


6.52 


HPP 


Questionnaire items 

Math not essential (#3) 


57.67 


HPP 


Historical approach good (#9) 


72.36 


HPP 


Book enjoyable to read (#12) 


15.95 


HPP 


Class finished text (#14) 


3.80 


HPP 


Most difficult high school course (#.16) 


8.22 


Other 


Physics has to be difficult (#17) 


7.90 


Other 


Hope course doesn’t change (#19) 


6.45 


HPP 


Historical 


27.16 


HPP 


Philosophical 


19.60 


HPP 


Mathematical 


14.76 


Other 


Humanitarian 


4.18 


HPP 


Social 


11.85 


HPP 


Applied 


7.90 


Other 



*F’s significant at the p < *10 level. 
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